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PRELIMINARY AMENDMENT A 

Assistant Commissioner for Patents 
Washington, D.C. 20231 

Dear Sir: 

Please amend the above identified patent application as follows before the examination of 
the application: 

In the Claims: 

Please cancel claims 1-43 without prejudice. 

1. (amended) An interface apparatus for interfacing motion of a user manipulable object 
with a computer system, said interface apparatus comprising: 

a user manipulable object being physically contacted by a user; 
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a 3-D spatial mechanism coupled to said user object and including a plurality of members 
including a ground member coupled to a ground , said spatial mechanism providing at least three 
degrees of freedom to said user manipulable object[, said three degrees of freedom including two 
degrees of freedom provided in a planar workspace and a third degree of freedom provided as 
rotation of said planar workspace about an axis] with respect to said ground [member]; 

three actuators rigidly coupled to said ground [member of] and coupled to said spatial 
mechanism, said actuators operative to apply forces in said three degrees of freedom to said user 
manipulable object in response to electrical signals from said computer system; and 

a sensor for detecting a position of said user manipulable object in three-dimensional 
space and for outputting sensor signals to said computer system. 



2. (amended) An interface apparatus as recited in claim 1 wherein said three degrees of 
freedom includ two degrees of freedom provided in a planar workspace and a third degree of 
freedom provided as rotation of said planar workspace about an axis, wherein a first and second 
of said actuators apply force in said planar workspace and a third of said actuators applies force 
about said axis. 

3. An interface apparatus as recited in claim 2 wherein at least some of said plurality of 
members of said spatial mechanism are formed as a closed loop linkage that provides said planar 
workspace. 

4. An interface apparatus as recited in claim 3 wherein said closed loop linkage includes 
five members, and wherein each of said five members of said closed loop linkage is rotatably 
coupled to at least two other members of said linkage, said five member linkage providing two of 
said three degrees of freedom. 

Please cancel claim 5 without prejudice. 

6. (amended) An interface apparatus as recited in claim [4] 1 wherein one of said 
members of said [closed loop linkage] 3-D spatial mechanism is a rotatable carriage rotatably 
coupled to [said] a ground member coupled to said ground , said carriage providing [said] a third 
degree of freedom. 

7. (amended) An interface apparatus as recited in claim [2] 1 further comprising means 
for transmitting a force from one of said actuators to said spatial mechanism [using a capstan 
drive mechanism, said capstan drive mechanism including a cable and pully for transmitting said 
force]. 



8. An interface apparatus as recited in claim 6 further comprising two capstan drive 
mechanisms, each coupled between one of said actuators and said closed loop linkage, wherein 
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each of said capstan drive mechanisms includes a drum coupled to said carriage and a pulley 
coupled to one of said actuators, wherein a member of said linkage is coupled to said drum, and 
wherein said drum is coupled to said pully by a cable such that said actuator is operative to rotate 
said pulley and thereby transmit force to said linkage with no substantial backlash. 

9. (amended) An interface apparatus as recited in claim [2] 1 wherein said user 
manipulable object includes a stylus. 

10. (amended) An interface apparatus as recited in claim [2] I wherein said user 
manipulable object includes at least a portion of a medical instrument. 

11. (amended) An interface apparatus as recited in claim [4] 1 further comprising a 
floating gimbal mechanism coupling said one of said plurality of members to said user 
manipulatable object to provide rotational movement for said object in a fourth degree of 
freedom. 

12. An interface apparatus as recited in claim 11 wherein said floating gimbal 
mechanism provides rotational movement for said user manipulable object in a fifth degree of 
freedom. 

13. An interface apparatus as recited in claim 12 further comprising: 

a fourth degree of freedom transducer coupled between members of said floating gimbal 
mechanism; and 

a fifth degree of freedom transducer coupled between members of said floating gimbal 
mechanism. 

Please cancel claim 14 without prejudice. 

15. An interface apparatus as recited in claim 12 wherein said user manipulable object is 
rotatable about a longitudinal sixth axis of said object to provide a sixth degree of freedom for 
said object, and further comprising a sixth degree of freedom transducer coupled between said 
object and said floating gimbal mechanism. 



Please cancel claims 16-21 without prejudice. 



22. (amended) A method [mechanical interface apparatus] for interfacing motion of a user 
manipulable object with a computer system, said [interface apparatus] method comprising: 



providing a user manipulable object being physically contacted by a user; 
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providing at least three degrees of freedom to said user manipulatab le obiect using a 3-D 
spatial mechanism coupled to said user manipulate object and including a plurality of members 
including a ground member rigidly coupled to a ground[, said spatial mechanism providing at 
least three degrees of freedom to said user manipulable object]; 

applying forces in three degrees of freedom to said user manipula te obiect in response to 
electrical signals from said computer system using three actuators rigidly coupled to said ground 
member of said spatial mechanism, [said actuators operative to apply forces in said three degrees 
of freedom to said user manipulable object in response to electrical signals from said computer 
system,] said three actuators being decoupled in force from each other such that none of said 
actuators can apply a force to any of said other actuators; and 

[a sensor for] detecting a position of said user manipulable object in three-dimensional 
space and outputting sensor signals to said computer system. 

23. (amended) A [mechanical interface apparatus] method as recited in claim 22 wherein 
said actuators provide forces in said three degrees of freedom using tensioned cables, wherein 
tension in each of said cables is independent of a tension in said other cables. 

24. (amended) A [mechanical interface apparatus] method as recited in claim 23 further 
comprising transmitting force to said linkage with no substantial backlash using two capstan 
drive mechanisms, each coupled between one of said first and second actuators and said plurality 
of members, wherein each of said capstan drive mechanisms includes a drum coupled to one of 
said members and a pulley coupled to one of said actuators, wherein a member of said linkage is 
coupled to said drum, and wherein said drum is coupled to said pully [by said cable such that 
said actuator is operative to rotate said pulley and thereby transmit force to said linkage with no 
substantial backlash]. 

25. (amended) A [mechanical interface apparatus] method as recited in claim 22 wherein 
said three degrees of freedom [including] include two degrees of freedom provided in a planar 
workspace and a third degree of freedom provided as rotation of said planar workspace about an 
axis with respect to said ground member. 

26. (amended) A [mechanical interface apparatus] method as recited in claim 25 wherein 
said two of said degrees of freedom are in a planar workspace provided by a parallel link 
mechanism, and a third of said degrees of freedom is provided by rotating said parallel link 
mechanism about an axis with respect to said ground member. 
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27. (amended) A mechanism for providing computer-controlled forces on a user 
manipulable object, the mechanism comprising: 

a user manipulable object graspable by a user; 

[an actuator coupled between a ground surface and said user manipulable object and 
being controllable to provide] means for outputtine a force in a degree of freedom of said user 
manipulatable object; 

transmission means for transmitting force [a capstan drive coupled] between said user 
manipulable object and said actuator, said [capstan drive] transmission means including [a] 
capstan drum means coupled to said user manipulable object and rotatable about a first axis and 
[a] rotatable pulley means coupled to and rotatable by said means for providing a force 
[actuator], wherein a flexible member is coupled between said drum means and said pulley 
means to transmit rotational force between said drum means and said pulley means ; and 

[a] carriage means for rotating said user manipula table object [rotatable] with respect to 
said ground surface about a second axis, wherein said drum means is rotatably coupled to said 
carriage means , and wherein said capstan drum means and said user manipulable object may be 
rotated about said second axis while said [actuator] means for outputting a force and said pulley 
means are fixed to said ground surface and do not rotate about said second axis, wherein said 
flexible member is twisted from said rotation about said second axis; 

whereby said user manipulable object is provided with a first degree of freedom about 
said first axis and a second degree of freedom about said second axis. 



28. (amended) A mechanism as recited in claim 27 further comprising a plurality of 
[sensors] sensing means coupled to said mechanism, said [sensors] sensing means for sensing a 
position of said user manipulatable object in said first and second degrees of freedom. 

Please cancel claim 29 without prejudice. 

30. (amended) A mechanism as recited in claim 27 further comprising [a] linkage means 
[of members] coupled between said user manipulatable object and said drum. 

31. (amended) A mechanism as recited in claim 30 further comprising [a] second [capstan 
drive] transmission means , said second capstan [drive] transmission means including: 

a second [capstan] drum means coupled between said user manipulable object and said 
carriage means and rotatable about a third axis to allow said user manipulable object to be moved 
in a planar workspace having said first degree of freedom and a third degree of freedom; 
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[a] second [actuator] means for outputting a force coupled to said ground surface and 
being controllable to provide a force in said third degree of freedom of said user manipulable 
object; and 

[a] second pulley means coupled to said second actuator[, said second pulley] and being 
coupled to said second capstan drum by a second flexible member. 

32. (amended) A mechanism as recited in claim 31 further comprising a third [actuator] 
means for outputting a force coupled to said ground surface, said third [actuator] means 
outputting [providing] a force in said second degree of freedom, wherein said three [actuators] 
means for outputting a force are each coupled to said ground surface. 

33. (amended) A mechanism as recited in claim 32 further comprising a third [capstan 
drive] transmission means coupled between said carriage and said third [actuator] means for 
outputting a force , said third [capstan drive] transmission means including [a] third [capstan] 
drum means rigidly coupled to said carriage means and rotatably coupled to said ground surface, 
[a] third pulley means coupled to said third [actuator] means for outputting a force , and a third 
[flexixible] flexible member coupled between said third drum means and said third pulley means . 

34. A mechanism as recited in claim 33 wherein said flexible members are metal cables. 

35. (amended) A mechanism as recited in claim 27 wherein said user manipulable object 
is one of a stylus and a medical instrument . 

Please cancel claim 36 without prejudice. 

37. (amended) A mechanism as recited in claim 30 wherein said user manipulable object 
is coupled to said linkage means [of members] by [a] floating gimbal [mechanism] means for 
providing [that provides at lesat] at least two additional degrees of freedom to said user 
manipulable object. 

Please cancel claims 38-56 without prejudice. 
Please add the following claims: 



57. (new) An interface apparatus as recited in claim 37 wherein said floating gimbal 
mechanism includes at least one capstan drive mechanism and at least one sensor, said capstan 
drive mechanism providing enhanced sensing resolution to said sensor. 
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58. (new) An interface apparatus for interfacing the motion of a stylus with a computer 
system that provides simulated feel sensations to a user holding said stylus, said interface 
apparatus comprising: 

a stylus manipulatable by a user in at least three degrees of freedom with respect to a 
ground surface; 

three actuators rigidly coupled to said ground surface; 

a mechanism that couples said stylus to said three grounded actuators, said mechanism 
allowing motion of said stylus in said three degrees of freedom and transmitting forces from said 
actuators to said stylus in said three degrees of freedom, wherein said mechanism includes a 
plurality of rigid members and a plurality of flexible members, wherein flex of at least one of 
said flexible members enables motion of said stylus with respect to said ground surface; and 

at least one sensor that detects a position of said user manipulatable object in three 
dimensions with respect to said ground surface. 

59. (new) An interface apparatus as recited in claim 58 wherein said flex of said flexible 
member is an axial twist. 

60. (new) An inteface apparatus as recited in claim 59 wherein said flexible members are 

cables. 

61. (new) An interface apparatus as recited in claim 58 wherein a plurality of members of 
said mechanism form a closed loop linkage of five rigid members, said closed loop linkage being 
driven by two of said three grounded actuators. 

62. (new) An interface apparatus as recited in claim 58 wherein said three degrees of 
freedom are translational degrees of freedom. 

63. (new) An interface apparatus as recited in claim 58 wherein said mechanism further 
comprises means for allowing three additional degrees of freedom of said stylus, said three 
additonal degrees of freedom being rotational degrees of freedom, thereby allowing said stylus to 
be manipulated in a full six degrees of freedom with respect to said ground surface. 

64. (new) An interface apparatus as recited in claim 58 wherein two of said three 
actuators are oriented approximately parallel with respect to each other and said third of said 
three actuators is oriented approximately perpendicular to said two parallel actuators. 



65. (new) An interface apparatus as recited in claim 64 wherein said two parallel 
actuators drive rigid links that form a closed loop chain of five members to apply forces upon 
said stylus in a two dimensional plane. 

66. (new) An interface apparatus as recited in claim 65 wherein said perpendicular 
actuator applies forces in at least one direction outside of said plane, thereby allowing forces in 
three dimensional space. 



Claims 1-4, 6-13, 15, 22-28, 30-35, 37, and 57-66 are pending in this application. Claims 
1, 2, 6, 7, 9-11, 22-33, 35, and 37 have been amended, claims 5, 14, 16-21, 29, 36 and 38-56 
have been cancelled, and claims 57-66 have been added by this Preliminary Amendment A. 

Applicant believes that all pending claims are allowable and respectfully requests a 
Notice of Allowance for this application from the Examiner. Should the Examiner believe that a 
telephone conference would expedite the prosecution of this application, the undersigned can be 
reached at the telephone number set out below. 



REMARKS 



Respectfully submitted, 




James R. Riegel 
Reg. 36,651 



San Jose, California 
(408) 467-1900 



MECHANICAL INTERFACE HAVING 
MULTIPLE GROUNDED ACTUATORS 

BY INVENTORS 

Kenneth M. Martin 

Mike D. Levin 

Louis B. Rosenberg 

BACKGROUND OF THE INVENTION 

The present invention relates generally to interface devices between humans and 
computers, and more particularly to computer interface devices that provide force feedback to the 
user. 

Virtual reality computer systems provide users with the illusion that they are part of a 
"virtual" environment. A virtual reality system will typically include a computer processor, such 
as a personal computer or workstation, specialized virtual reality software, and virtual reality I/O 
devices such as head mounted displays, sensor gloves, three dimensional ("3D") pointers, etc. 

Virtual reality computer systems can be used for training. In many fields, such as aviation 
and vehicle and systems operation, virtual reality systems have been used successfully to allow a 
user to learn from and experience a realistic "virtual" environment. The appeal of using virtual 
reality computer systems for training relates, in part, to the ability of such systems to allow trainees 
the luxury of confidently operating in a highly realistic environment and making mistakes without 
"real world" consequences. For example, a virtual reality computer system can allow a doctor- 
trainee or other human operator or user to "manipulate" a scalpel or probe within a computer- 
simulated "body", and thereby perform medical procedures on a virtual patient. In this instance, 
the I/O device which is typically a 3D pointer, stylus, or the like is used to represent a surgical 
instrument such as a scalpel or probe. As the "scalpel" or "probe" moves within a provided space 
or structure, results of such movement are updated and displayed in a body image displayed on the 
screen of the computer system so that the operator can gain the experience of performing such a 
procedure without practicing on an actual human being or a cadaver. In other applications, virtual 
reality computer systems allow a user to manipulate the controls of complicated and expensive 
vehicles and machinery for training and/or entertainment purposes. For example, a pilot or 
astronaut in training can operate a fighter aircraft or spacecraft by manipulating controls such as a 
control joystick and buttons and view the results of controlling the aircraft on a virtual reality 
simulation of the aircraft in flight. In yet other applications, a user can manipulate objects and tools 
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in the real world, such as a stylus, and view the results of the manipulation in a virtual reality world 
with a "virtual stylus" viewed on a screen, in 3-D goggles, etc. 

For virtual reality systems to provide a realistic (and therefore effective) experience for the 
user, sensory feedback and manual interaction should be as natural as possible. Therefore, in 

5 addition to sensing and tracking a user's manual activity and feeding such information to the 
controlling computer to provide a 3D visual representation to the user, a human interface 
mechanism should also provide force feedback ("haptic" or tactile sensations) to the user. The 
need for the user to experience realistic force information and sensation is extensive in many kinds 
of simulation and other applications. For example, in medical/surgical simulations, the "feel" of a 

10 probe or scalpel simulator is important as the probe is moved within the simulated body. It would 
~ invaluable to a medical trainee to learn through force feedaback how an instrument moves within a 
body, how much force is required depending on the operation performed, the space available in a 
body to manipulate an instrument, etc. In simulations of vehicles or equipment, force feedback for 
controls such as a joystick can be necessary to realistically teach a user the force required to move 

15 the joystick when steering in specific situations, such as in a high acceleration environment of an 
aircraft. In virtual world simulations where the user can manipulate objects, force feedback is 
necessary to realistically simulate physical objects; for example, if a user touches a pen to a table, 
the user should feel the impact of the pen on the table. An effective human/computer interface not 
only acts as an input device for tracking motion, but also as an output device for producing realistic 

20 force sensations. A "high bandwidth" interface system, which is an interface that mechanically 
and electrically allows accurate control over force feedback using fast control signals within a 
broad range of frequencies, is therefore desirable in these and other applications. 

In addition, there is a desire to provide force feedback to users of computer systems in the 
entertainment industry. Styluses, joysticks, and other interface devices can be used to provide 

25 force feedback to a user playing a video game or experiencing a simulation for entertainment or 
learning purposes. Through such an interface device, a computer system can convey to the user 
the physical sensation of colliding into a wall, moving through a liquid, driving over a bumpy 
road, and other sensations. The user can thus experience an entire sensory dimension in the 
gaming experience that was previously absent. Force feedback interfaces can provide a whole new 

30 modality for human-computer interaction. 

There are number of devices that are commercially available for interfacing a human with a 
computer for virtual reality simulations. There are, for example, 2-dimensional input devices such 
as mice, trackballs, joysticks, and digitizing tablets, as wells as 3-dimensional interface devices. A 
3-dimensional human/computer interface tool sold under the trademark Immersion Probe tm is 
35 marketed by Immersion Human Interface Corporation of Santa Clara, California, and allows 
manual control in 3-dimensional virtual reality computer environments. A pen-like stylus allows 



3 



for dexterous 3 -dimensional manipulation in six degrees of freedom using a serail configuration of 
links and joints. The Immersion Probe, however, does not provide force feedback to a user and 
thus does not allow a user to experience an entire sensory dimension in virtual reality simulations. 
Prior art force feedback instruments and joysticks provide physical sensations to the user by 
5 controlling motors that are coupled to the joystick. 

In typical multi-degree of freedom apparatuses that include force feedback, there are several 
disadvantages. Since actuators which supply force feedback tend to be heavier and larger than 
sensors, they would provide inertial constraints if added to a device such as the Immersion Probe. 
In a typical force feedback device, such as Per Force from Cybernet Systems Inc., a serial chain of 

10 links and actuators is implemented to achieve multiple degrees of freedom in a desired object 
positioned at the end of the chain, i.e., each actuator is coupled to the previous actuator. The user 
who manipulates the object must carry the inertia of all of the subsequent actuators and links 
except for the first actuator in the chain, which is grounded. For example, the user carries the 
weight of five ungrounded motors in the Per Force device. Other force feedback devices have a 

15 different, non-serial type of linkage, but include several ungrounded motors; for example, the 
Phantom from Sensable Devices Inc., includes three driven degrees of freedom but only one out 
of three motors is grounded. The end result is high inertia which corrupts the bandwidth of the 
system, providing the user with an inaccurate interface. These interfaces also introduce tactile 
"noise" to the user through friction and compliance in signal transmission and limit the degree of 

20 sensitivity conveyed to the user through the actuators of the device. 

Other systems, such as a joystick using a slotted bail mechanism, are able to provide two 
grounded actuators, which enhances the realism of the force feedback experienced by the user. 
However, these systems are limited in bandwidth by their mechanisms, which tend to be 
innaccurate and ill-suited for effectively transmitting forces to the user. In other other force 
25 feedback interfaces, such as the Impulse Engine from Immersion Corporation, two grounded 
actuators provide high bandwidth force feedback to a user in two degrees of freedom. However, if 
it is desired to provide forces in a third degree of freedom, then the user is typically required to 
carry the weight of the third actuator supplying force in that third degree of freedom, which 
degrades the realism of the forces felt using the force feedback interface device. 

30 In yet other force feedback interface systems, motors are coupled to a mechanism using 

cables which transmit forces from the motor to the mechanism. However, in many of these 
interface systems, the forces from one motor influence the tension on other motors and cables in 
the system, thus causing additional degradation in the force transmission. In addition, the 
calculation of forces to provide a desired force sensation to the user can be complicated in such a 

35 coupled actuator system, thus decreasing the response time of the system. 
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SUMMARY OF THE INVENTION 

The present invention provides a human/computer interface apparatus and method which 
can provide from one to six degrees of freedom to a user-manipulable object and highly realistic 
force feedback to the user of the apparatus. The structure of the apparatus and a capstan drive 
5 permits actuators to be grounded and thus positioned such that their inertial contribution to the 
system is very low. 

An interface apparatus and method of the present invention for interfacing the motion of a 
user-manipulable object with a computer system includes a user manipulate object physically 
contacted by a user, such as a stylus, medical/surgicalinstrument, joystick, or other graspable 

10 object. A 3-D spatial mechanism is coupled to the user object and provides at least three degrees 
of freedom to the user object, where the spatial mechanism includes multiple members including a 
ground member coupled to ground. Three actuators are rigidly coupled to the ground member and 
together apply a three-dimensional force to the user manipulate object in response to actuator 
signals from the computer system. Each actuator does not carry the weight of any of the other 

15 actuators, thus providing a highly accurate and realistic 3-D interface for the user. A sensor for 
detecting a position of said user manipulate object along said degree of freedom and outputting 
sensor signals to said computer system. A sensor detects a position of the user object along the 
degree of freedom and outputs sensor signals to the electrical system. 

The spatial mechanism preferably includes a planar five-member closed loop linkage riding 

20 on a rotatable carriage. The five-member linkage provides two degrees of freedom to the user 
manipulable object and includes two base members, two central members, and a ground member. 
The rotatable carriage is coupled to the ground member and provides a third degree of freedom to 
the user manipulable object. Force is transmitted from each said actuators to the spatial 
mechanism using capstan drive mechanisms. Two of the capstan drive mechanisms each include 

25 a drum coupled to the carriage such that a member of the spatial mechanism is coupled to the 
drum, and a pulley coupled to a grounded actuator. A drum is coupled to a corresponding pulley 
by a cable or other flexible member so that the actuator is operative to rotate the pulley and transmit 
force to the spatial mechanism in the first two degrees of freedom with no substantial backlash. 
Since the drums are coupled to the carriage, the pulley is coupled to the grounded actuator, and the 

30 cable between them is flexible, the drums may be rotated with the carriage while the pulleys 
remain fixed in position and the cable twists, thus providing a third degree of freedom for the user 
object. A third capstan drive mechanism is also preferably coupled between the the carriage and 
the grounded third actuator to provide forces in the third degree of freedom. Thus, all three 
actuators are grounded and decoupled in force from each other, thereby avoiding the inertia created 

35 by the weight of the actuators being carried by other actuators or carried by the user. 



5 



An interface apparatus of the present invention also may include a floating gimbal 
mechanism coupling one of the members of a linkage or other mechanism to the user 
manipulatable object. The floating gimbal mechanism includes a plurality of rotatably coupled 
gimbal members that provide two rotary degrees of freedom to the user manipulable object. A 
5 sensor is provided for each of the gimbal members for measuring a position of the members 
relative to each other in one of the rotary degrees of freedom. Preferably, a capstan mechanism is 
coupled -between each of the sensors and one of the gimbal members, where each capstan 
mechanism includes a capstan drum rotatable about an axis of one of the rotary degrees of 
freedom and a pulley coupled to the sensor and coupled to the drum by a flexible member, such as 
10 a metal cable. The capstan mechanisms provide mechanical reduction and thus enhance the 
resolution of the sensors. In other embodiments, the user manipulable object is rotatable about a 
longitudinal axis of the object to provide an additional degree of freedom for the object. 

The interface apparatus of the present invention includes three grounded, decoupled 
actuators to provide forces in three degrees of freedom of a user manipulable object. This 

15 improvement allows the user to manipulate the object free from the inertia caused by the weight of 
the actuators, and allows the other actuators to transmit forces to the user object without having to 
compensate for the inertia of other actuators, thereby providing more accurate and realistic forces. 
These unique twist capstan drive mechanisms allow the three actuators to be grounded while also 
providing mechanical advantage for the high bandwidth and low backlash forces from the 

20 actuators. The floating gimbal mechanism of the present invention provides capstan mechanisms 
in a unique configuration that allows the sensing resolution of the floating gimbal sensors to be 
enhanced while minimizing the weight of the floating gimbal mechanism. These improvements 
allow a computer system to have more complete and accurate control over a low-cost interface 
providing realistic force feedback. 

25 These and other advantages of the present invention will become apparent to those skilled 

in the art upon a reading of the following specification of the invention and a study of the several 
figures of the drawing. 
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BRIEF DESCRIPTION O F THE DRAWINGS 



Figure 1 is a perspective view of a virtual reality system which employs a mechanical 
interface apparatus of the present invention to interface a user manipulate object with a computer 
5 system; 

Figure 2 is a perspective view of a mechanical interface apparatus of the present invention 
for providing mechanical input and output to a computer system and having a stylus object; 

Figure 3 is a different perspective view of the mechanical apparatus of Figure 2 ; 

Figure 4 is a perspective of the mechanical apparatus of Figure 2 where the user 
10 manipulatable object has been moved in a third degree of freedom; 

Figure 5 is a perspective view of the mechanical apparatus of Figure 2 having a medical 
instrument as a user manipulable object; 

Figure 5a is a diagram of a surgical simulator using the medical instrument and mechanical 
apparatus of Figure 5; 

15 Figure 6 is a detailed view of a capstan drive mechanism used for two degrees of freedom 

in the present invention; 

Figure 7 is a detailed view of a capstan drive mechanism used for a third degree of 
freedom in the present invention; 

Figure 8 is a perspective view of the floating gimbal mechanism used in the mechanical 
20 apparatus of Figure 2 for fourth and fifth degrees of freedom; 

Figure 8a is a cross sectional view of Figure 8 along line 8a-8a showing the intermediate 
member of the floating gimbal mechanism; 

Figure 8b is a perspective view of a capstan mechanism and sensor used for a sixth degree 
of freedom; and 

25 Figure 9 is a block diagram of a computer and the interface between the computer and the 

mechanical apparatus of Figure 2. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 



FIGURE 1 illustrates a force feedback virtual reality system 10 used to provide a user- 
manipulable object in a virtual environment, simulation, or video game. Virtual reality system 10 
5 includes a user manipulate object 12, a mechanical interface 14, an electronic interface 16, and a 
host computer 18. The illustrated virtual reality system 10 includes a stylus 12 as a user 
manipulable object. 

User manipulable 12 used in conjunction with the present invention is manipulated by a 
user and, for example, virtual reality images are displayed on a display screen 20 of the computer 
10 system 18 in response to such manipulations. For example, a user can move a stylus 12 to 
correspondingly move a computer generated object, such as a cursor or other image, in a virtual 
environment. The available degrees of freedom in which user manipulable object 12 can be 
moved are determined from the mechanical interface 14, described below. 

It will be appreciated that a great number of other types of user manipulable objects can 
15 be used with the method and apparatus of the present invention. In fact, the present invention can 
be used with any mechanical object where it is desirable to provide a human/computer interface 
with multiple degrees of freedom. Such objects may include styluses, medical instruments such 
as laparoscopes and other endoscopic surgical tools, catheters, hypodermic needles, wires, fiber 
optic bundles, joysticks, spherical or other shaped hand grips, screw drivers, steering 
20 wheels/controls, pool cues, etc. Some of these other objects, such as a medical instrument, are 
described in detail subsequently. 

Mechanical interface apparatus 14 interfaces mechanical input and output between the user 
manipulating object 12 and host computer 18 implementing the simulation or game environment. 
Mechanical interface 14 provides multiple degrees of freedom to object 12; in the preferred 
25 embodiment, at least three and up to six degrees of freedom are provided to the user manipulable 
object, although fewer degrees of freedom can be provided in alternate embodiments. 

The user manipulates object 12 in 3-D space and the position and/or orientation of object 
12 is translated using mechanical interface 14 into a form suitable for interpretation by sensors of 
the mechanical interface 14, as described in greater detail below. The sensors track the movement 
30 of the object 12 in three-dimensional space and provide suitable elentronic signals to electronic 
interface 16. Electronic interface 16, in turn, provides position and/or orientation information to 
host computer 18. In addition, host computer 18 and/or electronic interface 16 provides force 
feedback information to actuators coupled to mechanical interface 14, and the actuators generate 
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forces on members of the mechanical apparatus to provide forces on object 12 in provided or 
desired degrees of freedom. The user experiences the forces generated on the stylus as realistic 
simulations of force sensations such as jolts, textures, "barrier" forces, and the like. For example, 
when a surface is generated on computer screen 20 and a computer object controlled by the user 
collides with the surface, the computer 18 will send force feedback signals to the electrical interface 
16 and mechanical apparatus 14 to generate collision forces on a stylus 12. Mechanical interface 

14 is shown in greater detail with respect to Figure 2. 

Electronic interface 16 is a component of the virtual reality system 10 and may couple the 
mechanical apparatus 14 to the host computer 18. Electronic interface 16 can be included within a 
housing of mechanical apparatus 14 or portions of the electronic interface can be provided as a 
-separate unit with its own housing. Alternatively, electronic interface 16 can be included in host 
computer 18. More particularly, electronic interface 16 includes sensor and actuator interfaces that 
convert electrical signals to appropriate forms usable by mechanical apparatus 14 and host 
computer 18. One suitable embodiment of interface 16 is described in detail with reference to 
Figure 9, in which the interface can include a dedicated interface card to be plugged into computer 
16. In alternate emodiments, interface 16 can include a microprocessor local to the mechanical 
interface 14 and separate from any microprocessors in the host computer 18 to control "reflex- 
force feedback independently of the host computer, as described below. 

The electronic interface 16 can be coupled to mechanical interface apparatus 14 by a bus 

15 (or may be included within the housing of apparatus 14) and is coupled to the computer 18 by a 
bus (or may be directly connected to the computer using a interface card). In other embodiments, 
signals can be sent to and from interface 16 and computer 18 by wireless transmission/reception. 
In preferred embodiments of the present invention, the interface 16 serves as an input/output (I/O) 
device for the computer 18. The interface 16 can also receive inputs from other input devices or 
controls that are associated with mechanical interface 14 or object 12 and can relay those inputs to 
computer 18. For example, commands sent by the user activating a button on mechanical interface 
14 can be relayed to computer 18 to implement a command or cause the computer 18 to output a 
command to the mechanical apparatus 14. Such input devices are described in greater detail with 
respect to Figure 9. 

Host computer 18 is preferably a personal computer or workstation, such as an IBM-PC 
compatible computer or Macintosh personal computer, or a SUN or Silicon Graphics workstation. 
For example, the computer 1 8 can operate under the Windows™ or MS-DOS operating system in 
conformance with an IBM PC AT standard. Alternatively, host computer system 18 can be one of 
a variety of home video game systems commonly connected to a television set, such as systems 
available from Nintendo, Sega, or Sony. In other embodiments, home computer system 1 8 can be 
a "set top box" which can be used, for example, to provide interactive television functions to users, 
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or a "hollow" or "internet" computer which allows users to interact with a local or global network 
using standard connections and protocols such as used for the Internet and World Wide Web. 
Host computer preferably includes a host microprocessor, random access memory (RAM), read 
only memory (ROM), input/output (I/O) circuitry, and other components of computers well- 
5 known to those skilled in the art. 

Host computer 18 implements a host application program with which a user is 
interacting via mechanical interface apparatus 14 and other peripherals, if appropriate. For 
example, the host application program can be a medical simulation, video game, scientific analysis 
program, or other application program that utilizes input of user object 12 and outputs force 
10 feedback to the object 12. The host application program checks for input signals received from 
electronic interface 16 and sensors of mechanical interface 14, and outputs force values and 
commands to be converted into forces on user object 12. Suitable software drivers which 
interface such simulation software with computer input/output (I/O) devices are available from 
Immersion Human Interface Corporation of San Jose, California. - 

15 Display device 20 is can be included in host computer 18 and can be a standard display 

screen or CRT, 3-D goggles, or any other visual interface. Typically, the host application provides 
images to be displayed on display device 20 and/or other feedback, such as auditory signals. For 
example, display screen 20 can display images from a game application program. Images 
describing a moving, first person point of view can be displayed, as in a virtual reality game. Or, 

20 images describing a third-person perspective of objects, backgrounds, etc. can be displayed. 
Alternatively, images froma simulation, such as a medical simulation, can be displayed, e.g., 
images of tissue and a representation of object 12 moving through the tissue, etc. 

In FIGURE 2, a perspective view of mechanical interface apparatus 14 for providing 
mechanical input and output in accordance with the present invention is shown. FIGURE 3 shows 
25 a perspective view of the mechanical apparatus 14 from a different perspective to illustrate the 
configuration and operation of apparatus 14. Apparatus 14 includes a mechanical linkage 30, a 
ground member 46, and a floating gimbal mechanism 32. In the embodiment of Figures 2 and 3, 
user manipulatable object 12 is preferably a stylus 35 or stylus-like object coupled to gimbal 
mechanism 32. 

30 Mechanical linkage 30 provides support for object 12 and couples the object to a ground 

member on a grounded surface 31, such as a tabletop or other support. Linkage 30 is, in the 
described embodiment, a 5-member (or "5-bar") linkage including rotatable carriage 34 that acts 
as a local ground, base member 36a coupled to a carriage 34, central member 38a coupled to base 
member 36a, base member 36b coupled to carriage 34, and central member 38b coupled to base 

35 member 36b. Fewer or greater numbers of members in the linkage can be provided in alternate 
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embodiments. Herein, linkage 30 is part of a 3-D spatial mechanism that includes linkage 30 and 
ground member 46 (described below). 

Rotatable carriage 34 acts as a local ground member for linkage 30, i.e., the carriage 34 is 
coupled to ground with respect to the linkage 30. However, carriage 34 can also rotate 
independently of ground 31 and a ground member 46 to which the carriage is coupled, as 
described below, and is thus not grounded with respect to the entire 3-D spatial mechanism. The 
members of linkage 30 are rotatably coupled to one another through the use of rotatable bearings 
or pivots, wherein base member 36a is rotatably coupled to carriage 34 by bearing 40a and can 
rotate about an axis A (a capstan drive mechanism is coupled between the base member and the 
bearing, as discussed below). Central member 38a is rotatably coupled to base member 36a by 
bearing 42a and can rotate about a floating axis C, base member 36b is rotatably coupled to 
carriage 34 by bearing 40b and can rotate about axis B, central member 38b is rotatably coupled to 
base member 36b by bearing 42b and can rotate about floating axis D, and central member 38b is 
rotatably coupled to central member 38b by bearing 44 such that central member 38b and central 
member 38a may rotate relative to each other about floating axis E. In the described embodiment, 
central member 38b is coupled at its end to a mid-portion of central member 38a and object 12 is 
coupled to the end of central member 38a. Floating gimbal mechanism 32 is coupled to member 
38a by bearing 45. In an alternate embodiment, the end of central member 38b can be coupled to 
the end of member 38a, as in a parallel linkage disclosed in co-pending patent application Serial 
No. 08/664,086 by Rosenberg et al., hereby incorporated by reference in its entirety. 

The axes C, D, and E are "floating" in the sense that they are not fixed in one position 
relative to ground surface 31 as are axes A and B. Preferably, the axes C, D, and E are all 
substantially parallel to each other. In alternate embodiments, base members 36a and 36b can be 
coupled to ground member 34 at the same axis, so that axes A and B are provided as one axis 
about which both members rotate. 

Linkage 30 is formed as a five-member closed-loop chain. Each member in the chain is 
coupled to two other members of the chain. The five-member linkage is arranged such that the 
members can rotate about their respective axes to provide user object 12 with two degrees of 
freedom. These provided degrees of freedom are within the x-z plane roughly indicated by the 
position of members, e.g., the linkage 30 of Figure 2 allows stylus 12 to be moved within a planar 
workspace defined by the x-z plane, which is defined by the x- and z-axes as shown in Figure 2. 
Linkage 30 is thus a "planar" five-member linkage, since it allows the user object 12 to be moved 
within a plane. So that the sub-linkage of members 36a and 38a does not interfere with or contact 
the sub-linkage of members 36b and 38b during movement of the linkage, members 36b and 38b 
are postioned to one side (i.e., offset along the y-axis) of members 36a and 38a using support 49. 
Linkage 30 can thus also be referred to as a "parallel link mechanism" since the linkage 30 is not a 
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serial chain of linked members and since members 36a and 38a are movable in a plane 
substantially parallel to members 36b and 38b. 

User object 12 can also be moved in a third degree of freedom. Rotatable carriage 34 
(more clearly shown with reference to Figure 3) acts as a local ground to linkage 30, but also may 
5 be rotated independently of linkage 30 with respect to a ground member 46. Ground member 46 
is coupled to or resting on a ground surface 31 which provides stability for apparatus 14. Ground 
member 46~is shown in the embodiment of Figure 2 having multiple components, including a 
base 46a supported by ground 3 1 , and a vertical portion 46b to which carriage 34 is coupled. 

Carriage 34 is rotatably coupled to ground member 46 by two couplings 47 arranged along 
10 a linear axis F, thus allowing carriage 34 to rotate about axis F. Base members 36a and 36b are 
rotatably coupled to carriage 34 such that the base members can rotate about axes A and B, as 
described previously. Axis F is preferably substantially perpendicular to axis A and axis B. With 
the inclusion of carriage 34 as a rotatable member, user object 1 2 can be moved in a third degree of 
freedom about axis F, thus allowing movement having a component along the y-axis. The motion 
15 in the third degree of freedom is illustrated in FIGURE 4, where carriage 34, linkage 30, and 
stylus 12 have been moved counterclockwise about axis F (viewed from above) as compared with 
the position shown in Figure 2. Thus, the three degrees of freedom provided to the user object by 
the spatial mechanism can be described as a planar workspace that is rotatable about an axis F. 
Carriage 34 carries the drums of the capstan drive mechanisms 48a and 48b about axis F, as 
20 described in greater detail with respect to Figure 6. 

Capstan drive mechanisms 48 are provided to transmit forces and motion between 
electromechanical transducers 51 and the stylus 12. The capstan drive mechanisms each include a 
drum, a pulley, and a cable. A capstan drive mechanism 48a is preferably coupled between 
ground member 46 and base member 36a, is routed through carriage 34, and operates to apply a 

25 force about axis A with respect to ground to base member 36a. A second capstan drive 
mechanism 48b is preferably coupled between ground member 34 and base member 36b, is 
routed through carriage 34, and operates to apply a force about axis B with respect to ground to 
base member 36b. Capstan mechanisms 48a and 48b include a drum 50 rotatably coupled to 
carriage 34 to rotate about axes A and B, respectively, and rigidly coupled to base members 36a 

30 and 36b, respectively. The capstan mechanisms 48a and 48b also include a number of pulleys 
coupled to carriage 34 and ground member 46, as described below. In addition, a third capstan 
drive mechanism 48c is preferably couped between ground member 46 and carriage 34. Drum 50 
of capstan mechanism 48c is rotatably coupled to ground member 34 and is rigidly coupled to 
carriage 46, thus allowing rotation of carriage 46 about axis F. The capstan drive mechanisms 

35 48a-c are described in greater detail with respect to Figures 6 and 7. 



12 



Capstan drive mechanisms 48a-c are included in mechanical apparatus 14 for a number of 
reasons. One is that the structure of the capstan drives 48 allows the actuators of the present 
invention to all be grounded and allow highly accurate transmission of forces. The capstan 
mechanisms allow forces with respect to ground to be independently applied to the base members 
5 of linkage 30 while allowing the entire linkage 30 to rotate about axis F with respect to ground, as 
explained below. Another reason for the capstan mechanisms is to provide mechanical advantage 
for forces generated by the actuators without introducing friction and backlash to the system. 

Also coupled to linkage 30 are transducers 5 1 , which may include a sensor and/or an 
actuators. Transducers 5 1 are provided between members of the apparatus and provide input to 
10 and output between mechanical apparatus 14 and a computer system, such as computer 18. 

In the described embodiment, three transducers 51 are preferably bi-directional 
transducers which include sensors 52. The sensors 52 collectively sense the rotational 
postion/movement of the stylus 12 in the provided degrees of freedom. Sensor 52a senses 
movement of base member 36a about axis A, sensor 52b senses movement of base member 36b 
15 about axis B, and sensor 52c senses movement/position of carriage 46 about axis F. These 
positions about axes A, B and F, if known, allow the determination of the position of object 12 
using known constants such as the lengths of the members of linkage 30 and floating gimbal 
mechanism 32, and using well-known coordinate transformations. 

Sensors 52 can be, for example, relative optical encoders which provide signals to 
20 measure the angular rotation (i.e., rotational position) of a shaft of the transducer. The electrical 
outputs of the encoders are routed to electronic interface 16, as detailed with reference to Figure 9. 
Other types of sensors 52 can also be used, such as potentiometers, etc. In addition, it is also 
possible to use non-contact sensors at different positions relative to mechanical apparatus 14. For 
example, a Polhemus (magnetic) sensor can detect magnetic fields from objects; or, an optical 
25 sensor such as lateral effect photo diode includes an emitter/detector pair that detects positions of 
the emitter with respect to the detector in one or more degrees of freedom; for example, a photo 
diode by Hamamatsu Co., part S 1743, can be used. These types of sensors are able to detect the 
position of object 12 in particular degrees of freedom without having to be coupled to a joint of the 
mechanical apparatus. Alternatively, sensors can be positioned at other locations of relative motion 
30 or joints of mechanical apparatus 14. In addition, velocity sensors (e.g., tachometers) and 
acceleration sensors (e.g., accelerometers) can also be used instead of or in addition to position 
sensors. 

It should be noted that the present invention can utilize both absolute and relative sensors. 
An absolute sensor is one which the angle of the sensor is known in absolute terms, such as with 
35 an analog potentiometer. Relative sensors only provide relative angle information, and thus require 
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some form of calibration step which provide a reference position for the relative angle information. 
The sensors described herein are primarily relative sensors. In consequence, there is an implied 
calibration step after system 10 power-up wherein the sensor's shaft is placed in a known position 
within the mechanism 14 and a calibration signal is provided to the system to provide the reference 
5 position mentioned above. All angles provided by the sensors are thereafter relative to that 
reference position. Such calibration methods are well known to those skilled in the art and, 
therefore, will not be discussed in any great detail herein. 

Transducers 51 also preferably include actuators 54 to transmit 3-dimensional forces to 
object 12 in 3-D space, i.e., in three degrees of freedom to the user object. The housing of the 

10 transducer of actuator 54a is rigidly coupled to ground member 46 and the actuator transmits 
rotational forces to base member 36a about axis A through a capstan drive mechanism (described 
below). Likewise, actuator 54b is rigidly coupled to ground member 46 and transmits rotational 
forces to base member 36b about axis B through a second capstan drive mechanism. The 
combination of rotational forces about axis A and axis B allows forces to be transmitted to object 

15 12 in all directions in the planar workspace provided by linkage 30 through the rotational 
interaction of the members of linkage 30. A third actuator 54c is rigidly coupled to ground 
member 46 and transmits rotational forces about axis F to carriage 34 through a third capstan drive 
mechanism, described with reference to Figure 7. The third actuator provides forces in the third 
degree of freedom to user manipulable object 12 about axis F. The housings of the three grounded 

20 actuators are coupled to the same ground such that the housings of these actuators cannot move 
with respect to each other. 

Actuators 54 can be of two types: active actuators and passive actuators. Active actuators 
include linear current, control motors, stepper motors, pneumatic/hydraulic active actuators, and 
other types of actuators that transmit a force to force or move an object. For example, active 

25 actuators can drive a rotational shaft about an axis in a rotary degree of freedom, or drive a linear 
shaft along a linear degree of freedom. Active transducers of the present invention are preferably 
bi-directional, meaning they can selectively transmit force along either direction of a degree of 
freedom. For example, DC servo motors can receive force control signals to control the direction 
and torque (force output) that is produced on a shaft. In the described embodiment, active linear 

30 current control motors, such as DC servo motors, are used. The control signals for the motor are 
produced by computer 18 and electronic interface 16 and are detailed with respect to Figure 9. The 
motors may include brakes which allow the rotation of the shaft to be halted in a short span of 
time. The sensors and actuators in transducers 51 are preferably included together as 
sensor/actuator pair transducers, but can also be provided separately. A suitable transducer for the 

35 present invention including both an optical encoder and current controlled motor is a 20 W basket 
wound servo motor manufactured by Maxon. 
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In alternate embodiments, other types of active motors can also be used, such as a stepper 
motor, brushless DC motors, pneumatic/hydraulic actuators, a torquer (motor with limited angular 
range), or a voice coil, which are well known to those skilled in the actuator art. Stepper motors 
and the like are not as well suited for the present invention because stepper motor control involves 
5 the use of steps or pulses which can be felt as pulsations by the user, thus corrupting the virtual 
simulation. The present invention is better suited to the use of linear current controlled actuators, 
which do not have this noise. 

Passive actuators can also be used in transducers 51. Magnetic particle brakes, friction 
brakes, or pneumatic/hydraulic passive actuators can be used in addition to or instead of a motor to 

10 generate a damping resistance or friction in a degree of motion. An alternate preferred 
embodiment only including passive actuators may not be as realistic as an embodiment including 
motors; however, the passive actuators are typically safer for a user since the user cannot be 
"joked" by generated forces. Passive actuators typically can only provide bi-directional resistance 
to a degree of motion. A suitable magnetic particle brake for interface mechanism 14 is available 

15 from Force Limited, Inc. of Santa Monica, California. 

In other embodiments, all or some of transducers 5 1 can include only sensors to provide 
an apparatus without force feedback along designated degrees of freedom. Similarly, all or some 
of transducers 51 can be implemented as actuators without sensors to provide only force feedback. 

In addition, in some embodiments, passive (or "viscous") damper elements can be 
20 provided on the bearings of apparatus 14 to remove energy from the system and intentionally 
increase the dynamic stability of the mechanical system. This may have the side effect of 
degrading the bandwidth of the system; however, if other factors such as the speed of a controller 
(e.g., a local microprocessor), rate of actuator control, and position sensing resolution already 
degrade the bandwidth, then such dampers may be acceptable. For example, inexpensive plastic 
25 dampers, such as rotational dampers produced by Fastex/Deltar, can be placed at desired bearing 
positions and have one end grounded. In other embodiments, this passive damping can be 
introduced by using the back electromotive force (EMF) of the actuators 54 to remove energy 
from the system. This can also be accomplished by using a shunt resistor coupled across the 
terminals of a motor or the coils of a voice coil actuator. Also, passive brakes, as mentioned 
30 above, can be used. In addition, in voice coil embodiments, multiple wire coils can be provided, 
where some of the coils can be used to provide back EMF and damping forces. 

The transducers 51a-51c of the described embodiment are advantageously positioned to 
provide a minimal amount of inertia to the user handling object 12. All three of the transducers 51 
are grounded meaning that each of the transducers is directly and rigidly coupled to ground 
35 member 34 which is coupled to ground surface 31, i.e., the ground surface carries the weight of 
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the transducers, not the user handling object 12; and that none of the actuators must provide forces 
to overcome the carried weight of any of the other actuators. The weights and inertia of all the 
transducers 51 are thus substantially negligible to a user handling and moving object 12. This 
provides a more realistic interface to a virtual reality system, since the computer can control the 
transducers to provide substantially all of the forces felt by the user in these degrees of motion. In 
addition, the transducers 51a-51c are "decoupled," meaning that the actuators are decoupled in 
force such that force generated from one actuator does not impose forces (such as back drive 
forces) on any of the other actuators that must be compensated for. The motors/cables of the 
capstan drive mechanisms (described with respect to Figure 6) are all tension independent, i.e., 
each motor and cable is substantially decoupled in tension from the other motors, thus allowing a 
more realistic and accurate force transmission system. In addition, the decoupling of the actuators 
allows the mathematical determination of forces providing a desired force sensation to the user 
object to be simpler and therefore faster than if the actuators were coupled. 

Apparatus 14 is a high bandwidth force feedback system, meaning that the mechanical and 
electrical components allow high frequency signals to be used to control transducers 51 and these 
high frequency signals will be applied to the user object with high precision and dependability. 
The user feels very little compliance or "mushiness" when handling object 12 due to the high 
bandwidth. In contrast, in typical prior art arrangements of multi-degree of freedom interfaces, at 
least one actuator "rides" upon another actuator in a serial chain of links and actuators, or the user 
must carry the heavy weight of at least one actuator when manipulating object 12. This low 
bandwidth arrangement causes the user to feel the inertia of coupled actuators when manipulating 
an object. In addition, many prior art devices have coupled motors coupled together by cables, 
where the force applied by one motor creates tension on the other motors which must be 
compensated for and which leads to inaccurate force transmission and slow, complicated force 
calculations by the host computer. The present invention does not have to output compensating 
forces for the weight of any actuators, has tension-independenUmotors and cables; therefore, a full 
three degrees of freedom are actuated by grounded actuators with substantially no coupling, thus 
providing an accurate mechanical force feedback interface for 3-D virtual reality and simulation 
applications. 

Floating gimbal mechanism 32 is included in the described embodiment of mechanical 
apparatus 14 to provide additional degrees of freedom to object 12. Gimbal mechanism 32 
includes a first member 60 rigidly coupled to central member 38a of linkage 30, and a second 
member 62 pivotally coupled to the first member 60. Object 12 is rigidly coupled to second 
member 62. Gimbal mechanism 32 provides two additional degrees of freedom (i.e., fourth and 
fifth degrees of freedom) to object 12: a rotary degree of freedom about axis G, and a different 
rotary degree of freedom about axis H that is substantially perpendicular to axis G. Gimbal 
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mechanism 32 preferably includes sensors to track the position of user object 12 in the fourth and 
fifth degrees of freedom provided by the gimbal mechanism about axes G and H. In preferred 
embodiments, a sixth degree of freedom is provided as a rotary "spin" movement of the stylus 35 
about an axis I extending through member 38a. In such an embodiment, a sensing mechanism 64 
can be included to track the motion about axis I, described with reference to Figure 8b. The gimbal 
mechanism 32 preferably includes capstan drive mechanisms and is described in greater detail 
with respect to Figure 8. Alternatively, the object 12 can be rotated and sensed in a sixth degree of 
freedom about its own lengthwise axis I\ In yet other embodiments of mechanical apparatus 14, 
gimbal mechanism 32 can be omitted and user object 12 can be coupled directly to linkage 30. 

User manipulatable object (or "user object") 12 is coupled to mechanical interface 14 and 
is preferably an interface object for a user to grasp, grip, or otherwise" manipulate in three 
dimensional (3D) space. User object 12 may be moved in all provided five degrees of freedom 
provided by linkage 30 and gimbal mechanism 32 and additional degrees of freedom if 
implemented. One example of a user object 12is a stylus 35 as shown in Figure 2, which can be 
grasped and manipulated by the user to point to various positions in 3-D space at various 
orientations. By "grasp," it is meant that users may releasably engage a portion of the object in 
some fashion, such as by hand, with their fingertips, or even orally in the case of handicapped 
persons. 

" Stylus 35 can be used, for example, to control a computer-generated object in a virtual 
environment, such as a cursor, virtual stylus, pointer, or other object. The user can move the 
stylus in 3D space to point to graphical objects or write words, drawings, or other images, etc. 
displayed on a display device. A virtual stylus can be presented in a virtual hand of the user on the 
display device. The computer system tracks the position of the stylus with sensors as the user 
moves it. The computer system also provides force feedback to the stylus when the user moves 
the stylus against a generated surface such as a virtual desk top, writes on a virtual pad of paper, 
etc. It thus appears and feels to the user that the stylus is contacting a real surface. In addition, the 
stylus 35 can include additional controls, such as one or more buttons that initiate specific 
commands to computer system 18 when the user depresses the buttons. In yet other 
embodiments, other additional peripheral devices can be coupled to computer system 18 and/or 
mechanical apparatus 14 to operate in conjunction with stylus 35, such as a mouse, track ball, foot 
pedal, voice recognition hardware, etc. 

In other embodiments, different user objects 12 can be coupled to linkage 30. An example 
of a medical instrument is described with reference to Figure 5. Other medical instruments, 
joysticks, grips, etc., can be provided as user object 12 in other embodiments, as described above. 
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Optionally, additional transducers can be added to mechanical interface 14 in provided or 
additional degrees of freedom of object 12. For example, actuators can be added to gimbal 
mechanism 32 to provide forces in the fourthn fifth and sixth degrees of freedom about axes G, H, 
and I. Such actuators would preferably be smaller than the actuators 54a-c, since the user would 
5 need to carry the weight of actuators on gimbal mechanism 32. 

FIGURE 5 is a perspective view of mechanical apparatus 14 having a medical instrument 
66 for user object 12". Mechanical apparatus 14 shown in Figure 5 operates substantially the same 
as the apparatus shown in Figures 2-4. User object 12, however, is a medical instrument 66 which 
the user can move in six degrees of freedom. In the described embodiment, medical instrument 
10 66 are foreceps, which can be used, for example, to perform surgery procedures in the skull of a 
patient by inserting a shaft through the nasal passages of the patient. A portion of the shaft 68 can 
be coupled to central member 38a of linkage 30. The grip portion 70 of the instrument 66 is 
grasped by the user as in a normal surgical procedure. 

A medical procedure is simulated by sensing the motion of the medical instrument 66 and 
15 outputting forces on the instrument as appropriate. A user can move the medical instrument 66 in 
the six provided degrees of freedom, similar to the stylus 53 of Figure 2. The movements in these 
six degrees of freedom will be sensed and tracked by computer system 18 using the sensors 52a-c, 
sensors included in gimbal mechanism 32 and the sensor of mechanism 64 (described below with 
reference to Figures 8 and 8b). Forces can be applied in the first three degrees of freedom by the 
20 computer system to simulate the insturment impacting a portion of the simulated subject body, 
experiencing resistance moving through body tissues, etc. In addition, a visual representation of 
the tool in the simulated tissues can be displayed on display screen 20 by computer 18 that is 
coordinated with the fprces and motion of instrument 66. In this way, both the feel and appearance 
of a procedure of inserting instrument 66 into body cavities and tissue is realistically simulated to 
25 provide a trainee a useful training process. Thus, when a surface is generated on the computer 
screen, the computer will send feedback signals to the object 12 and mechanical apparatus 14 using 
actuators 54a-c for generating appropriate forces in response to the position of a virtual instrument 
relative to the surface depicted on the computer screen. 

In the described embodiment, medical instrument 66 includes sensors and not actuators 
30 for the fourth through sixth degrees of freedom, similar to the embodiment of Figure 2. Actuators 
can be provided for these degrees of freedom if desired. The sixth degree of freedom is preferably 
provided as "spin" about the axis I or axis I' through the instrument, and can be sensed with an 
additional sensor. For typical medical procedures, rotational force feedback to a user about axis I 
is typically not required to simulate actual operating conditions. In alternate embodiments, an 
35 actuator such as a motor can be included to provide force about axis I or axis F. 
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In some embodiments, the movement of medical instrument 66 can be constrained such 
that a shaft portion 68 has only three or four free degrees of motion. For some medical 
instruments, this is a good simulation of the real use of a medical tool in that once it is inserted into 
a patient, it is limited to about four degrees of freedom. The shaft 68 can be constrained at some 
5 point of along its length such that it can move with four degrees of freedom within the patient's 
body. 

Another example of a medical user object is a laparoscopic tool used to simulate a 
laparoscopic medical procedure. The virtual reality system 10 may include a barrier and a standard 
laparoscopic trocar. The barrier is used to represent portion of the skin covering the body of a 
10 patient, and the trocar is inserted into the body of the virtual patient to provide an entry and removal 
point from the body of the patient for the laparoscopic tool, and to allow the manipulation of the 
laparoscopic tool. 

Additional transducers can also be added to the medical instrument 66. For example, a 
transducer 71, such as a Hall effect sensor, can be added to grip 70 of instrument 66 to sense when 
15 the user moves the two portions of the grip 70 relative to each other to simulate extending a cutting 
blade of the tool. Such sensors are described in U.S. Patent Application Serial No. 08/275,120, 
filed July 14, 1994 and entitled "Method and Apparatus for Providing Mechanical I/O for 
Computer Systems" assigned to the assignee of the present invention and incorporated herein by 
reference in its entirety. 

20 FIGURE 5a is a diagram illustrating one embodiment of using mechanical apparatus 14 

with medical instrument 66 in a force feedback medical simulator 72. In the example shown, a 
simulation of an endoscopic nasal surgical procedure is provided, where foreceps 66 are inserted 
into a patient's nostrils, through a nasal passage, and into a simulated sinus cavity. 

Simulator 72 includes mechanical apparatus 14, foreceps 66, shaft 68, and a head model 
25 74. Mechanical apparatus 14 is provided behind head model 74 so that it cannot be seen by the 
trainee/user of the simulator. Head model 74 can be made of rubber, plastic, or other resilient 
material. The actuators of the mechanical apparatus 14 are coupled to a ground surface 31. Shaft 
68 is coupled to floating gimbal mechanism 32 in the place of stylus 35 of Figure 2. Shaft 68 of 
foreceps 66 extends from the floating gimbal mechanism and out through an orifice 76 in head 
30 model 74, the orifice representing a patient's nostril. The forceps 66 can be pivoted about its shaft 
68 at an entry point located at the orifice 76. The nostril can thus be used as a constraint to 
movement, similar to a trochar, to guide and angle the tool 66. In other embodiments, the orifice 
76 can be provided with the use of a trochar or other tool, as is well known in the medical arts. 
Computer 18 monitors the position of the foreceps in the provided six degrees of freedom and 
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controls the three dimensional forces on the foreceps using actuators 52a-c, as described with 
reference to Figure 9. 

In operation, the trainee/user handles the grip 70 of the foreceps 66 and moves the foreceps 
66 through the nasal passage in the provided six degrees of freedom. The head model 74 is useful 

5 in that the trainee can place his or her hands on the model to orient himself or herself as if he or she 
were performing the procedure on a real patient. Forces are exerted in three dimensions using the 
actuators of the mechanical apparatus 14 to simulate the walls of the nasal passage and the feel of 
other tissues. The user does not feel the weight of any of the actuators while manipululating the 
instrument. The trainee can thus receive an accurate surgical experience which can help the trainee 

10 perform the complex surgical tasks on a real patient. Additional tools can "also be used in the 
surgical procedure; for example, a scope or other visual instrument can be inserted in the other 
nostril of head 74 to simulate providing a view of the nasal cavity. The view can be simulated by 
displaying simulated images of the nasal cavity on display screen 20 of computer 18. 

FIGURE 6 is a detailed view of capstan drive mechanisms 48a and 48b. The capstan drive 
15 mechanism 48a coupled to base member 36a is shown in Figure 6; capstan mechanism 48b 
coupled to extension arm 36b is substantially similar to the mechanism presented here. Capstan 
drive mechanisms 48a and 48b include a capstan drum 50, capstan drive pulley 80, and capstan 
idler pulleys 82. Capstan drum 50 is a member having a spherical outer surface 84. In the 
described embodiment, drum 50 is an approximately semi-circular-shaped member. Apertures 86 
20 are provided in drum 50 to reduce the weight of the drum and to thus allow the actuators to move 
the drum more easily. Alternatively, a single large aperture that extends between the edges of 
drum 50 can be provided to reduce the weight of the drum further, as described in co-pending 
patent application 08/374,288, filed 1/18/95, assigned to the same assignee as the present 
application, and incorporated by reference herein in its entirety. Other shapes of drum 50 can be 
25 used in other embodiments. Drum 50 is rotatably coupled to carriage 46 so that the drum is 
rotatable about axis A (or axis B for capstan drive mechanism 48b). Base member 36a is rigidly 
coupled to drum 50 such that when capstan drum 50 is rotated about axis A, extension member 
36a is also rotated. Curved outer surface 84 is preferably formed in an arc centered about axis A. 

Three pulleys are included in capstan drive mechanism 48a. Drive pulley 80 is a 
30 cylindrical roller coupled to a shaft that is coupled to transducer 51a, the transducer including 
actuator 54a and sensor 52a. Actuator 54a drives the shaft and pulley 80 when so controlled by the 
computer system 18. Similarly, sensor 52a detects rotational movement of pulley 80 by detecting 
rotational change of position of the shaft. Idler pulleys 82a and 82b are cylinders rotatably coupled 
to carriage 46 and preferably rotate freely. 
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Capstan drum 50 is coupled to pulleys 80, 82a, and 82b by a cable 90. Cable 90 is 
preferably a thin, durable metal cable. Other types of flexible cables, cords, wire, string, bands, 
etc. can be used as well. Cable 90 is attached at a first end 92 of drum 50 on one side of the drum 
by a fastener 91, and the cable is drawn tautly against the outer surface 84 of drum 50. Cable 90 is 
5 wrapped around idler pulley 82a one or more times and is then routed to drive pulley 80 as shown. 
After being wrapped around drive pulley one or more times, the cable 90 is routed to idler pulley 
82b, where it is wrapped one or more times. Finally, cable 90 is again drawn tautly against the 
outer surface 84 of drum 50 toward second end 94 and the second end of cable 90 is firmly 
attached to the drum 50 near end 94 by fastener 93. 

10 Cable 90 should be routed such that it is substantially aligned with axis F in the portion 

routed between idfer pulley 82a and drive pulley 80 and between idler pulley 82b and drive pulley 
80. This configuration permits the torsional flexibility of the cable 90 to be utilized to allow the 
drum 50 to be rotated about axis F with carriage 46 while drive pulley 80 remains fixed to ground. 
That is, the twist of the cable between the idler pulleys and the drive pulley enables drum 50 to be 

15 rotated on carriage 34 about axis F with respect to the pulley 80, which remains fixed with respect 
to axis F, without significantly affecting the tension force on drum 50. This is because the 
tensioned cable can be rigid along its axial dimension to provide the necessary force transmission 
between drum and pulley, and the cable can simultaneously be torsionally flexible for torsion 
around the axial dimension to allow the rotation of drum 50 about axis F. Of course, the cable is 

20 also flexible along it length to allow it to be bent or wrapped around pulleys and drum 50. 

Drive pulley 80 transmits rotational force from transducer 51a to capstan drum 50 and 
transmits force/motion from capstan drum 50 to transducer 51a. Rotational force is applied from 
transducer 51a to pulley 80 when the actuator 54a of transducer 51a rotates its shaft coupled to 
drive pulley 80. Drive pulley 80, in turn, transmits the rotational force via cable 90 to idler pulleys 

25 82a and 82b. Idler pulleys 82a and 82b guide cable 90 to drum 50 and the force is transmitted to 
capstan drum 50, thus forcing the drum to rotate in a direction about axis A. Base member 36a 
rotates with capstan drum 50, thus causing force within the planar workspace of object 12 
provided by linkage 30. Note that pulleys 80, 82a, and 82b, capstan drum 50 and extension 
member 36a will only actually rotate from the actuator-applied force if the user is not applying the 

30 same amount or a greater amount of rotational force to object 1 2 in an opposite direction to cancel 
the rotational movement. In any event, the user will feel the rotational force generated on object 12 
as force feedback. 

Pulleys 80, 82a and 82b are not threaded in the described embodiment, since the tension 
between cable and pulley is high enough to provide adequate friction between pulley and cable. In 
35 alternate embodiments, threads or grooves can be provided on one or more of the pulleys to help 
guide cable 90 and to allow less tension in cable 90. For example, cable 90 can be wrapped around 
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pulley 80 so that the cable is positioned between threads, i.e., the cable is guided by the threads. 
As pulley 80 is rotated by transducer 51a or by the manipulations of the user, the portion of cable 
90 wrapped around the pulley 80 travels closer to or further from the end of the pulley, depending 
on the direction that pulley 80 rotates. 

5 The capstan drive mechanisms 48a and 48b provide mechanical advantage to apparatus 14 

so that the force applied to the user object 12 can be increased in magnitude without using more 
power or larger actuators. The ratio of the diameter of drive pulley 80 to the diameter of capstan 
drum 50 (i.e. double the distance from axis A to the edge 84 of capstan drum 50) dictates the 
amount of mechanical advantage, similar to a gear system. In the decribed embodiment of Figure 

10 2, the ratio of drum to pulley is equal to 6:1, although other ratios can be used in other 
embodiments. 

Similarly, when the user moves object 12 in the x-z plane, base member 36a rotates about 
axis B and rotates capstan drum 50. This movementcauses cable 90 to move, which transmits the 
rotational force around idler pulleys 82a and 82b to drive pulley 80. Pulley 80 and the shaft of 
15 transducer 51a rotate from this movement, and the direction and magnitude of the movement is 
detected by the sensor 54a of transducer 51a. As described above with respect to the actuators, the 
capstan drive mechanism provides a mechanical advantage to amplify the sensor resolution by a 
ratio of diameters of drum 50 to pulley 80 ( 1 5: 1 in the preferred embodiment). A similar actuation 
and sensing process occurs for rotation of drum 50 of the other capstan drive mechanism 48b. 

20 The tension in cable 90 should be at a level so that negligible backlash or play occurs 

between capstan drum 50 and pulleys 80, 82a, and 82b. Preferably, the tension of cable 90 can be 
adjusted by pulling more (or less) cable length through end 92 and/or end 94 of drum 50. For 
example, adjustable fasteners 91 and 93 are be included on the ends of curved surface 84 to tighten 
cable 90. A stop (not shown) can also be provided in the rotational path of drum 50 or base 

25 member 36a to prevent capstan drum 50 from moving beyond a designated angular limit and to 
prevent damage to components of the mechanical apparatus 14 due to user movement and 
generated forces. 

Capstan drive mechanism 48 is advantageously used in the present invention to provide the 
described transmission of forces and mechanical advantage between transducers 51a-b and object 
30 12 without introducing substantial compliance, friction, or backlash to the system. A capstan drive 
provides increased stiffness, so that forces are transmitted with negligible stretch and compression 
of the components. The amount of friction is also reduced with a capstan drive mechanism so that 
substantially "noiseless" tactile signals can be provided to the user. In addition, the amount of 
" backlash contributed by a capstan drive is also negligible. "Backlash" is the amount of play that 
35 occurs between two coupled rotating objects in a gear or pulley system. Two gears, belts, or other 
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types of drive mechanisms could also be used in place of capstan drive mechanism 48 in alternate 
embodiments to transmit forces between transducer 51a and base member 36a. However, gears 
and the like typically introduce some backlash in the system. In addition, a user might be able to 
feel the interlocking and grinding of gear teeth during rotation of gears when manipulating object 
5 1 2; the rotation in a capstan drive mechanism is much less noticeable. 

Since each capstan mechanism 48 includes its own cable that is not connected to any other 
capstan mechanism, and since the twist of the cable about axis F does not significantly affect the 
tension force on drum 50, each of the three actuators 52a-c are decoupled. That is, the force 
applied by once actuator in one cable does not affect the tension in other cables or actuators. 

10 Importantly, the cable capstan drive shown in Figure 6 also allows three .actuators to be 

grounded in the mechanical apparatus 14 of the present invention without including a complex 
and/or low bandwidth transmission system. Drive pulley 80 can be coupled to transducer 48a and 
grounded, while pulleys 82a and 82b and drum 50 are coupled to carriage 34 and are therefore 
rotatable about axis F and not grounded. Cable 90 allows this configuration, since the cable is 

15 torsionally flexible and permits the drum sections of the capstan drives 48a-b to be moved about 
axis F relative to the drive pulley, which is stationary with respect to axis F. Idler pulleys 82a and 
82b are provided to support the tension of cable 90 for drum 50 when carriage 46 is rotated. 
When the carriage 34 is rotated about axis F, the cables of both capstan drive mechanisms 48a and 
48b twist to allow this rotation. Thus, the rotatable carriage 34 allows the planar workspace of 

20 linkage 30 to be rotated about axis F. Cable 90 acts as a rigid structural member with respect to 
transmission of forces between the pulley and drum, but also acts as a flexible member allowing 
the capstan drum to move its axis of rotation with respect to the pulley. The result is a mechanical 
interface allowing thre,e degrees of freedom to a manipulated object and three grounded, decoupled 
actuators to provide highly realistic, high bandwidth forces to the user object 12. 

25 FIGURE 7 is a detail perspective view of capstan drive mechanism 48c. Drive 

mechanism 48c is similar to capstan drive mechanisms 48a and 48b, with the exception that no 
idler pulleys 82a and 82b are required in drive 48c since the axis of rotation of the drum 50 is not 
rotated with respect to the driven pulley, e.g., there is no rotation of the drum out of the plane 
defined by the pulley and drum. 

30 Capstan drive mechanism 48c includes a capstan drum 100 and a pulley 102. Drum 100 is 

rigidly coupled to carriage 46 such that when carriage 46 is rotated about axis F, drum 100 is also 
rotated about axis F. Pulley 102 is rigidly coupled to a rotating shaft 104 of transducer 51c. Shaft 
104 may be rotated by actuator 54c of transducer 51c, and sensor 52c of transducer 51c can detect 
rotational movement or position of shaft 104. 
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Capstan drum 100 is coupled to pulley 102 by a cable 106, similar to cable 90 of capstan 
drive mechanisms 48a and 48b. A first end of cable 90 is fastened to one end 108 of the curved 
surface 1 10 of drum 100. Cable 90 is drawn along surface 1 10 and is wrapped around pulley 102 
one or more times as shown. Cable 90 is then drawn along the other portion of surface 1 10 to the 
5 second end 1 12 of the drum 100, where the second end of the cable is fastened as described above. 

In operation, transducer 51c rotates shaft 104 and pulley 106, and cable 90 transmits the 
rotational force to drum 100. Drum 100 thus rotates about axis F, which causes the carriage 46 to 
rotate about axis F. Linkage 30, gimbal mechanism 32 and object 12 thus rotate about axis F since 
they are coupled to carriage 46. Likewise, when sensing motion, the user moves object 12 about 
10 axis F, which causes carriage 46 to rotate about axis F. This causes drum 50 to similarly rotate, 
and the rotational force is transmitted to pulley 102 through cable 106. The pulley 102 and shaft 
104 rotate, and this rotation is sensed by sensor 52c. 

Capstan drive mechanism 48c provides all the mechanical advantage, low backlash, and 
high bandwidth features discussed above for the other capstan drives. Since capstan drives 48a 
15 and 48b are coupled between ground member 34 and carriage 46 by flexible cables, the carriage 
can be moved in a third degree of freedom about axis F while maintaining actuator 54c at a 
grounded position, thereby increasing the accuracy of the forces transmitted to object 12 from 
transducer 51c and from object 12 to the transducer when object 12 is moved by the user. 

FIGURE 8 is detailed perspective view of floating gimbal mechanism 32 as shown in 
- 20 Figure 2. In the preferred embodiments, the user object 12 is coupled to the gimbal mechanism 32 
which provides two degrees of freedom to the user object in addition to the three degrees of 
freedom provided by linkage 30 and carriage 46 described above with reference to Figures 2 and 3. 

Gimbal mechanism 32 includes a first gimbal member 1 10 and a second gimbal member 
112. First member 110 is rigidly coupled to central member 38a at one end and is rotatably 

25 coupled to second member 1 12 at its other end. In the described embodiment, first member 1 10 is 
shaped in a "U" configuration having two legs such that an intermediate member 1 16 is rotatably 
coupled to the first member 1 10 between the legs of the "U." Intermediate member 1 16 is shown 
more clearly in Figure 8a as a cross sectional view, where the member 1 16 is preferably shaped as 
a cross such that the legs of each "U" 1 10 and 1 12 are rotatably coupled on opposing legs of the 

30 cross. 

First member 110 also preferably includes a capstan mechanism 118. A sensor 120 is 
preferably rigidly coupled between the legs of member 1 10 such that a rotatable shaft 122 of the 
sensor is coupled to a pulley 124 of capstan drive 118. Pulley 124 is coupled to a capstan drum 
126 of the capstan mechanism 1 18 by a cable 128. The first end of cable 128 is fastened at one 
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end 130 of drum 126 by a fastener 131 and is routed along surface 132 of the drum 126, around 
pulley 124, along surface 132, and to second end 134 of drum 126, where it is fastened by a 
fastener 135. Capstan drum 126 is rotatably coupled to member 110 and rigidly coupled to 
intermediate member 116 such that drum 126 and intermediate member 1 16 are rotatable about an 
axis G. Thus, when intermediate member 1 16 is rotated about axis G, drum 126 is also rotated. 
This causes cable 128 to move and pulley 124 to rotate. The rotation of pulley 124 causes rotation 
of shaft 122, and sensor 120 detects the position (or change in position) of the shaft and relays a 
signal to computer 18. Capstan mechanism 118 thus functions similarly to capstan drive 48c 
described with_reference to Figure 7. However, in the preferred embodiment, no actuator is 
coupled to shaft 122, since the gimbal mechanism is a floating, lightweight mechanism that has no 
grounded members. 

Second member 1 12 is preferably a U-shaped member similar to first member 1 10 and is 
rotatably coupled to intermediate member 116. Second member 112 can rotate about axis G as 
intermediate member 1 16 rotates. Second member 1 12 includes a capstan mechanism 140 that is 
similar to capstan mechanism 118 of first member 110. Thus, a sensor 142 is rigidly coupled 
between legs of second member 112 such that a rotatable shaft 144 of the sensor is coupled to a 
pulley 146 of capstan mechanism 140. Pulley 146 is coupled to a capstan drum 148 of the capstan 
mechanism 140 by a cable 150. The first end of cable 150 is fastened at one end 152 of drum 148 
by a fastener 153 and is routed along a surface 154 of the _drum 148, around pulley 146, along 
surface 154, and to second end 156 of drum 148, where it is fastened by a fastener 157. Capstan 
drum 148 is rotatably coupled to member 1 12 and is rigidly coupled to intermediate member 116. 
Member 112 can be rotated about an axis H that is substantially perpendicular to axis G with 
respect to drum 148 and intermediate member 116. Thus, when second member 112 is rotated 
about axis H, drum 148 and intermediate member 116 do not rotate. This causes cable 150 to 
move and pulley 146 to rotate, thus causing rotation of shaft 144, which sensor 142 detects. The 
sensor 142 outputs an appropriate signal to computer 18. 

Stylus 35 or other user object 12 is rigidly coupled to second member 1 12. Thus, stylus 
can be moved about axis H in conjunction with second member 1 12. In addition, stylus 35 can be 
moved about axis G in conjunction with second member 112 and intermediate member 116. 
Object 12, such as stylus 35, is rotatably coupled to member 1 12 and can be spun about an axis I. 
A sensor is preferably included at the opposite end of member 38a to measure such movement, as 
shown in Figure 8b. Alternatively, the sensor can be included at the near end of member 38a. In 
yet other embodiments, object 12 can be spun about axis I\ and a sensor can be coupled between 
user object 12 and member 1 12 to sense this rotation for computer 18. 

In the preferred embodiment, six degrees of freedom of user object 12 are sensed. Thus, 
both the position (x, y, z coordinates) and the orientation (roll, pitch, yaw) of the user object can be 
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detected by computer 18 to provide a highly realistic simulation. In other embodiments, different 
mechanisms besides the floating gimbal mechanism 32 can be used to provide the fourth, fifth and 
sixth degrees of freedom; or fewer degrees of freedom can be provided. 

The capstan mechanisms 118 and 140 provide mechanical reduction for the sensors 120 
5 and 142, and thereby enhance the resolution of the sensors in detecting position of the user object. 
In the described embodiment, at least 4: 1 mechanical reduction can be attained. This sensor 
resolution enhancement allows much smaller sensors to be used, thus significantly reducing the 
size and weight of the floating gimbal mechanism to achieve a more realistic and accurate force 
feedback interface. 

10 Sensors 120 and 142 can optical encoders as described above or any type of sensor that 

provides electrical signals indicating movement about an axis to electronic interface 16. In other 
embodiments, actuators can be included in addition to the sensors to provide forces about axes G 
and H (and I, if applicable) upon command from computer system J 8 or other controller. 
However, actuators are preferably not included for the fourth, fifth, and sixth degrees of freedom 

15 in the described embodiment, since actuators are typically heavier than sensors and, when 
positioned at the locations of sensors 120 and 142, would create more inertia in the system. In 
addition, the force feedback for the first three degrees of freedom provided by linkage 30 and 
carriage 46 allows impacts and resistance to be simulated, which is typically adequate in many 
virtual reality applications. Force feedback in the fourth, fifth, and sixth degrees of freedom would 

20 allow torques on user object 12 to be simulated as well, which may or may not be useful in a 
particular application. 

FIGURE 8b is a perspective view of a sensing mechanism 64 that detects motion (or 
velocity, acceleration, etc.) of object 12 in the sixth degree of freedom about axis I. Mechanism 64 
is included at the end of member 38a opposite to the floating gimbal mechanism. Alternatively, 
25 mechanism 64 can be provided at the same end as gimbal mechanism 32. 

Sensing mechanism 64 preferably includes a sensor 160 including a rotatable shaft or 
pulley 161, a capstan drum 162, an interior shaft 164. Shaft 164 is rigidly coupled to bearing 45 
and member 1 10 at one end of member 38a and extends through the interior of member 38a. 
Capstan drum 162 is rigidly coupled to the opposite end of shaft 164. Capstan drum 162 is 
30 coupled to shaft 161 by a cable 168, where cable 168 is wrapped from one end 166 of drum 162, 
around shaft 161, and to the other end 170 of drum 162, similarly to the capstan mechanisms of 
gimbal mechanism 32. The housing of sensor 160 is rigidly coupled to bearing 42a and the shaft 
161 may rotate with respect to the housing. 
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When member 1 10 of gimbal mechanism 32 is rotated, bearing 45 and interior shaft 164 
are also rotated. This, in turn, rotates drum 162 and shaft 161 via cable 168. Sensor 160 is thus 
able to sense rotation about axis I and send output signals to computer 18. The drum 162 and 
pulley 161 provide mechanical reduction and enhanced sensing resolution to sensor 160 similarly 
5 to gimbal mechanism 162. 

Alternatively, sensor 160 can be provided at the bearing 45 end of member 38a, and wires 
to the sensor can be routed through member 38a. For example, the sensor 160 can be rigidly 
coupled to member 38a and rotating shaft 161 of sensor 160 can be coupled to member 1 10 (or, 
the opposite configuration can be used, with the rotating shaft coupled to member 38a). 

10 FIGURE 9 is a block diagram of a computer 18 and an interface 16 to send and receive 

signals to and from mechanical apparatus 14. The interface 16 preferably includes such 
components as an interface card 200, DAC 202, power amplifier circuit 204, and sensor interface 
206. In this embodiment, the interface 16 between computer 18 and mechanical apparatus 14 as 
shown in Figure 1 can be considered functionally equivalent to the interface 16 enclosed within the 

15 dashed line in Figure 9. Other types of interfaces 16 can also be used. For example, an electronic 
interface is described in U.S. Patent Application Serial No. 08/461,170, Atty Docket No. 
08/461,170, filed 6/5/95, assigned to the assignee of the present invention and incorporated herein 
by reference in its entirety. The electronic interface described therein has six channels 
corresponding to the six degrees of freedom of a mechanical linkage. 

20 Interface card 200 is preferably a card which can fit into an interface slot of computer 18. 

For example, if computer 18 is an IBM AT compatible computer, interface card 16 can be 
implemented as an PCI, ISA, VESA, or other standard interface card which plugs into the 
motherboard of the computer, provides input and output ports connected to the main data bus of 
the computer, and may include memory, interface circuitry, and the like. In alternate 

25 embodiments, no interface card 200 need be used, and a direct interface bus can be provided from 
interface 16 and computer 18. For example, a serial interface such as RS-232, Universal Serial 
Bus (USB), or Firewire can be used to connect a serial port or parallel port of computer 18 to 
interface 16. Also, networking hardware and protocols, such as ethernet and TCP/IP, can also be 
used to communicate signals. 

30 Digital to analog converter (DAC) 202 is coupled to interface card 200 and receives a 

digital signal from computer 18. DAC 202 converts the digital signal to analog voltages which are 
then sent to power amplifier circuit 204. DAC circuits suitable for use with the present invention 
are described in co-pending patent application 08/374,288, incorporated by reference herein in its 
entirety. Power amplifier circuit 204 receives an analog low-power control voltage from DAC 202 

35 and amplifies the voltage to control actuators of the mechanical apparatus 14. A suitable power 
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amplifier circuit 204 is described in greater detail in co-pending patent application 08/374,288. 
Sensor interface 206 receives and converts signals from sensors 52 to a form appropriate for 
computer 18, as described below. 

Mechanical interface apparatus 14 is indicated by a dashed line in Figure 9 and includes 
actuators 210, sensors 212, and mechanisms 214 including linkage 30, gimbal mechanism 32, and 
capstan drives 48. Actuators 210 can one or more of a variety of types of actuators, such as the 
DC motors 54, passive actuators, valves, or any additional actuators for providing force feedback 
to a user manipulated object 12 coupled to mechanical apparatus 14. The computer 18 determines 
appropriately scaled digital values to send to the actuators. Actuators 210 receive the computer 
signal as an amplified analog control signal from power amplifier 204. 

Sensors 212 are preferably digital sensors that provide signals to computer 18 relating the 
position of the user object 12 in 3D space. In the preferred embodiments described above, sensors 
212 are relative optical encoders, which are electro-optical devices that respond to a shaft's rotation 
by producing two phase-related signals and outputting those signals to sensor interface 206. In the 
described embodiment, sensor interface circuit 206 is preferably a single chip that converts the two 
signals from each sensor into another pair of clock signals, which drive a bi-directional binary 
counter. The output of the binary counter is received by computer 18 as a binary number 
representing the angular position of the encoded shaft. Such circuits, or equivalent circuits, are 
well known to those skilled in the art; for example, the Quadrature Chip from Hewlett Packard, 
California performs the functions described above. 

Alternatively, analog sensors can be included instead of or in addition to digital sensors 
212, such as potentiometers. Or, a strain gauge can be connected to the user object 12 to measure 
forces. Also, velocity sensors and/or accelerometers can be used to directly measure velocities and 
accelerations on object 12 in a particular degree of freedom. Analog sensors provide an analog 
signal representative of the position/velocity/acceleration of the user object in a particular degree of 
motion. In such an embodiment, sensor interface 206 includes an analog to digital converter 
(ADC) to convert the analog sensor signal to a digital signal that is received and interpreted by 
computer 18, as is well known to those skilled in the art. 

Mechanisms 214 include linkage 30, floating gimbal mechanism 32, and capstan drives 48 
and are operative to interface the movement and forces between the user object 12 and the sensors 
and actuators. From the mechanical movement of the mechanisms 214, the computer 18 receives 
inputs in the x-z plane from sensors 52a and 52b and inputs about axis F from sensor 52c; 
additional inputs about axes G, H and I are input from sensors 120, 142, and 160. Using the 
mechanical movement of the mechanisms 214, computer 18 outputs forces on the user object in 
the first three degrees of freedom. 



28 



Other input devices can also be included on user object 12 or on mechanical apparatus 14 
to allow the user to input additional commands. For example, buttons, levers, dials, etc. can input 
signals to interface 16 to inform the computer 18 when these input devices have been activated by 
the user. 

5 In other embodiments, the interface 16 can be included in computer 18 or in mechanical 

apparatus 14. In yet other embodiments, the interface 16 can include a separate, local 
microprocessor that is dedicated to handling much of the force feedback functionality of the 
mechanical apparatus 14 independently of computer 18. Such an embodiment, and other related 
interface functions, are described in greater detail with respect to co-pending patent application 

10 08/566,282, Atty docket no. IMM1P014, hereby incorporated by reference herein in its entirety. 

While this invention has been described in terms of several preferred embodiments, it is 
contemplated that alterations, modifications and permutations thereof will become apparent to 
those skilled in the art upon areading of the specification and study of the drawings. For example, 
the members of apparatus 14 can take a number of actual physical sizes and forms while 

15 maintaining the disclosed linkage structure. In addition, other gimbal mechanisms can also be 
provided included to provide additional degrees of freedom. Likewise, other types of gimbal or 
spatial mechanisms or different mechanisms providing multiple degrees of freedom can be used 
with the capstan drive mechanisms and grounded actuators disclosed herein to reduce inertia, 
friction, and backlash in a system. A variety of devices can also be used to sense the position of an 

20 object in the provided degrees of freedom and to drive the object along those degrees of freedom. 
Furthermore, certain terminology has been used for the purposes of descriptive clarity, and not to 
limit the present invention. It is therefore intended that the following appended claims include all 
such alterations, modifications and permutations as fall within the true spirit and scope of the 
present invention. 



25 What is claimed is: 
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CLAIMS 

1. An interface apparatus for interfacing motion of a user manipulate object with a 
computer system, said interface apparatus comprising: 

5 a user manipulate object being physically contacted by a user; 

a 3-D spatial mechanism coupled to said user object and including a plurality of members 
including a ground member, said spatial mechanism providing at least three degrees of freedom to 
said user manipulate object, said three degrees of freedom including two degrees of freedom 
provided in a planar workspace and a third degree of freedom provided as rotation of said planar 
10 workspace about an axis with respect to said ground member; 

three actuators rigidly coupled to said ground member of said spatial mechanism, said 
actuators operative to apply forces in said three degrees of freedom to said user manipulate object 
in response to electrical signals from said computer system; and 

a sensor for detecting a position of said user manipulate object in three-dimensional space 
15 and outputting sensor signals to said computer system. 

2. An interface apparatus as recited in claim 1 wherein a first and second of said actuators- 
apply force in said planar workspace and a third of said actuators applies force about said axis. 

3. An interface apparatus as recited in claim 2 wherein at least some of said plurality of 
20 members of said spatial mechanism are formed as a closed loop linkage that provides said planar 

workspace. 

4. An interface apparatus as recited in claim 3 wherein said closed loop linkage includes 
five members, and wherein each of said five members of said closed loop linkage is rotataty 
coupled to at least two other members of said linkage, said five member linkage providing two of 

25 said three degrees of freedom. 

5. An interface apparatus as recited in claim 4 wherein said closed loop five member 
linkage includes: 

a local ground member rotatably coupled to said ground member; 
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first and second base members, each base member being coupled to said local ground 
member; and 

first and second central members, said first central member having an end coupled to said 
first base member and an end coupled to said user object, and said second central member having 
an end coupled to said second base member and an end coupled to said first central member. 

6. An interface apparatus as recited in claim 4 wherein one of said members of said closed 
loop linkage is a rotatable carriage rotatably coupled to said ground member, said carriage 
providing said third degree of freedom. 

7. An interface apparatus as recited in claim 2 further comprising transmitting a force from 
one of said actuators to said spatial mechanism using a capstan drive mechanism, said capstan 
drive mechanism including a cable and pully for transmitting said force. 

8. An interface apparatus as recited in claim 6 further comprising two capstan drive 
mechanisms, each coupled between one of said actuators and said closed loop linkage, wherein 
each of said capstan drive mechanisms includes a drum coupled to said carriage and a pulley 
coupled to one of said actuators, wherein a member of said linkage is coupled to said drum, and 
wherein said drum is coupled to said pully by a cable such that said actuator is operative to rotate 
said pulley and thereby transmit force to said linkage with no substantial backlash. 

9. An interface apparatus as recited in claim 2 wherein said user manipulable object 
includes a stylus. 

10. An interface apparatus as recited in claim 2 wherein said user manipulable object 
includes at least a portion of a medical instrument. 

11. An interface apparatus as recited in claim 4 further comprising a floating gimbal 
mechanism coupling said one of said plurality of members to said user manipulatable object to 
provide rotational movement for said object in a fourth degree of freedom. 

12. An interface apparatus as recited in claim 1 1 wherein said floating gimbal mechanism 
provides rotational movement for said user manipulable object in a fifth degree of freedom. 

13. An interface apparatus as recited in claim 12 further comprising: 

a fourth degree of freedom transducer coupled between members of said floating gimbal 
mechanism; and 
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a fifth degree of freedom transducer coupled between members of said floating gimbal 
mechanism. 

14. An interface apparatus as recited in claim 13 further comprising a capstan mechanism 
coupled between said members of said floating gimbal apparatus, said capstan mechanism 

5 including a pulley coupled to one of said fourth and fifth degree of freedom transducers and a 
rotatable drum coupled between said members of said floating gimbal mechanism. 

15. An interface apparatus as recited in claim 12 wherein said user manipulable object is 
rotatable about a longitudinal sixth axis of said object to provide a sixth degree of freedom for said 
object, and further comprising a sixth degree of freedom transducer coupled between said object 

10 and said floating gimbal mechanism. 

16. An interface apparatus for interfacing motion of a user manipulable object with a 
computer system, said interface apparatus comprising: 

a user manipulable object being physically contacted by a user; 

15 a linkage of a plurality of members coupled to said user manipulable object, wherein said 

object has first and second degrees of freedom provided by said linkage; 

a rotatable carriage coupled between said linkage and a ground, said rotatable carriage 
providing a third degree of freedom to said user manipulable object; 

first, second, arid third actuators coupled to said ground and operative to provide forces in 
20 said three degrees of freedom in response to actuator signals from said computer system; and 

a plurality of sensors, at least one of said sensors coupled to said linkage and at least one of 
said sensors coupled to said rotatable carriage, said sensors sensing a position of said object in said 
three degrees of freedom and outputting sensor signals to said computer system. 

25 17. An interface apparatus as recited in claim 16 wherein said linkage and said carriage 

form a closed loop five member linkage. 

18. An interface apparatus as recited in claim 16 wherein transmission of force from said 
first and second actuators to said object along first and second degrees of freedom is provided via a 
capstan drive included for each of said first and second actuators, wherein said capstan drives are 
30 coupled between said first and second actuators, respectively, and said linkage. 
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19. An interface apparatus as recited in claim 18 wherein transmission of force from said 
third actuator to said object is provided via a third capstan drive coupled between said carriage and 
said ground. 

20. An interface apparatus as recited in claim 18 wherein said first and second capstan 
5 drives each include a capstan drum coupled to said carriage, a pulley coupled to a grounded 

actuator, and a flexible cable coupled between said capstan drum and said pulley, wherein torsional 
flexibility of said cable allows said carriage and drum to move with respect to said pulley. 

21. An interface apparatus as recited in claim 16 further comprising a plurality of sensors 
operative to sense a position or an orientation of said object in fourth, fifth and sixth degrees of 

10 freedom of said object. 

22. A mechanical interface apparatus for interfacing motion of a user manipulate object 
with a computer system, said interface apparatus comprising: 

a user manipulate object being physically contacted by a user; 

15 a 3-D spatial mechanism coupled to said user object and including a plurality of members 

including a ground member rigidly coupled to a ground, said spatial mechanism providing at least 
three degrees of freedom to said user manipulate object; 

three actuators rigidly coupled to said ground member of said spatial mechanism, said 
actuators operative to apply forces in said three degrees of freedom to said user manipulate object 
20 in response to electrical signals from said computer system, said three actuators being decoupled in 
force from each other such that none of said actuators can apply a force to any of said other 
actuators; and 

a sensor for detecting a position of said user manipulate object in three-dimensional space 
and outputting sensor signals to said computer system. 

25 

23. A mechanical interface apparatus as recited in claim 22 wherein said actuators provide 
forces in said three degrees of freedom using tensioned cables, wherein tension in each of said 
cables is independent of a tension in said other cables. 

24. A mechanical interface apparatus as recited in claim 23 further comprising two capstan 
30 drive mechanisms, each coupled between one of said first and second actuators and said plurality 
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of members, wherein each of said capstan drive mechanisms includes a drum coupled to one of 
said members and a pulley coupled to one of said actuators, wherein a member of said linkage is 
coupled to said drum, and wherein said drum is coupled to said pully by said cable such that said 
actuator is operative to rotate said pulley and thereby transmit force to said linkage with no 
5 substantial backlash. 

25. A mechanical interface apparatus as recited in claim 22 wherein said three degrees of 
freedom including two degrees of freedom provided in a planar workspace and a third degree of 
freedom provided as rotation of said planar workspace about an axis with respect to said ground 
member. 

10 26. A mechanical interface apparatus as recited in claim 25 wherein said two of said 

degrees of freedom are in a planar workspace provided by a parallel link mechanism, and a third of 
said degrees of freedom is provided by rotating said parallel link mechanism about an axis with 
respect to said ground member. 

15 27. A mechanism for providing computer-controlled forces on a user manipulable object, 

the mechanism comprising: 

a user manipulable object graspable by a user; 

an actuator coupled between a ground surface and said user manipulable object and being 
controllable to provide a force in a degree of freedom of said user manipulatable object; 

20 a capstan drive coupled between said user manipulable object and said actuator, said 

capstan drive including a capstan drum coupled to said user manipulable object and rotatable about 
a first axis and a rotatable pulley coupled to and rotatable by said actuator, wherein a flexible 
member is coupled between said drum and said pulley to transmit rotational force between said 
drum and said pulley; and 

25 a carriage rotatable with respect to said ground surface about a second axis, wherein said 

drum is rotatably coupled to said carriage, and wherein said capstan drum and said user 
manipulable object may be rotated about said second axis while said actuator and said pulley are 
fixed to said ground surface and do not rotate about said second axis, wherein said flexible 
member is twisted from said rotation about said second axis; 

30 whereby said user manipulable object is provided with a first degree of freedom about said 

first axis and a second degree of freedom about said second axis. 
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28. A mechanism as recited in claim 27 further comprising a plurality of sensors coupled 
to said mechanism, said sensors sensing a position of said user manipulatable object in said first 
and second degrees of freedom. 

5 29. A mechanism as recited in claim 27 wherein said second axis is substantially 

perpendicular to said first axis. 

30. A mechanism as recited in claim 27 further comprising a linkage of members coupled 
between said user manipulatable object and said drum. 

31. A mechanism as recited in claim 30 further comprising a second capstan drive, said 
10 second capstan drive including: 

a second capstan drum coupled between said user manipulable object and said carriage and 
rotatable about a third axis to allow said user manipulable object to be moved in a planar 
workspace having said first degree of freedom and a third degree of freedom; 

a second actuator coupled to said ground surface and being controllable to provide a force 
15 in said third degree of freedom of said user manipulable object; and 

a second pulley coupled to said second actuator, said second pulley being coupled to said 
second capstan drum by a second flexible member. 

32. A mechanism as recited in claim 31 further comprising a third actuator coupled to said 
ground surface, said tjiird actuator providing a force in said second degree of freedom, wherein 

20 said three actuators are each coupled to said ground surface. 

33. A mechanism as recited in claim 32 further comprising a third capstan drive coupled 
between said carriage and said third actuator, said third capstan drive including a third capstan 
drum rigidly coupled to said carriage and rotatably coupled to said ground surface, a third pulley 
coupled to said third actuator, and a third flexixible member coupled between said third drum and 

25 said third pulley. 

34. A mechanism as recited in claim 33 wherein said flexible members are metal cables. 

35. A mechanism as recited in claim 27 wherein said user manipulable object is a stylus. 

36. A mechanism as recited in claim 27 wherein said user manipulable object is a medical 
instrument. 
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37. A mechanism as recited in claim 30 wherein said user manipulate object is coupled to 
said linkage of members by a floating gimbal mechanism that provides at lesat two additional 
degrees of freedom to said user manipulate object. 

5 38. A hman-computer interface mechanism comprising: 

a user manipulate object; 

a linkage of members providing two degrees of freedom to said user manipulate object; 

a floating gimbal mechanism coupling said user manipulate object to said linkage of 
members, said floating gimbal mechanism including: 

10 a plurality of rotatably coupled gimbal members, said gimbal members providing two 

rotary degrees of freedom said user manipulate object; 

a sensor provided for each of said gimbal members for measuring a position of said 
members relative to each other in one of said rotary degrees of freedom, such that each sensor 
measures motion in a different rotary degree of freedom; and 

15 a capstan mechanism coupled between each of said sensors and one of said gimbal 

members, each of said capstan mechanisms including a capstan drum rotatable about an axis of 
one of said rotary degrees of freedom and a pulley coupled to said sensor and coupled to said 
drum by a flexible member. 

20 39. An interface mechanism as recited in claim 38 wherein said floating gimbal 

mechanism is rotatably coupled to said linkage of members, thereby providing an additional rotary 
degree of freedom to said user manipulate object. 

40. An interface mechanism as recited in claim 38 wherein an intermediate member is 
coupled between said gimbal members of said floating gimbal mechanism. 

25 41. An interface mechanism as recited in claim 38 wherein said two rotary degrees of 

freedom provided by said floating gimbal mechanism are substantially perpendicular to each other, 
such that axes of rotation for said rotary degrees of freedom are substantially mutually 
perpendicular. 
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42. An interface mechanism as recited in claim 41 wherein said flexible member is a 

cable. 

43. An interface mechanism as recited in claim 40 wherein said gimbal members are 
substantially U-shaped and are coupled to each said intermediate member approximately at legs of 

5 said U-shape. 

44. An interface mechanism as recited in claim 38 wherein said capstan mechanism 
provides at least a 4: 1 mechanical reduction in motion between said capstan drum and said pulley. 

45. An interface mechanism as recited in claim C5 wherein said user manipulate object is 
a stylus. 

10 46. An interface mechanism as recited in claim C5 wherein said user manipulate object is 

at least a portion of a medical instrument. 



47. A method for interfacing motion of a user manipulate object with a computer system, 
the method comprising: 

15 providing a linkage of members movable such that an object engaged with said linkage has 

first and second degrees of freedom; 

providing a rotatable carriage between said linkage and a ground, said rotatable carriage 
providing a third degree of freedom to said object; 

actuating a force in each of said three degrees of freedom using first, second, and third 
20 actuators, wherein said three actuators are each fixed to a single ground; and 

sensing a position of said object in each of said three degrees of freedom; and 

providing electrical signals to and from a computer system for controlling said force and 
relaying said position. 

48. A method as recited in claim 47 wherein said linkage is a closed loop five member 
25 linkage. 

49. A method as recited in claim 47 wherein a transmission of force from said first and 
second actuators to said object along first and second degrees of freedom is provided via a capstan 
drive included for each of said first and second actuators, wherein said capstan drives are coupled 
between said first and second actuators, respectively, and said linkage. 
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50. A method as recited in claim 49 wherein transmission of force from said third actuator 
to said object is provided via a third capstan drive coupled between said carriage and said ground. 

51. A method as recited in claim 49 wherein said first and second capstan drives each 
include a capstan drum coupled to said carriage, a pulley coupled to a grounded actuator, and a 

5 flexible cable coupled between said capstan drum and said pulley, wherein torsional flexibility of 
said cable allows said carriage and drum to move with respect to said pulley. 

52. A method as recited in claim 47 further comprising a step of transducing an electrical 
signal for fourth, fifth and sixth degrees of freedom of said object using fourth, fifth, and sixth 
transducers, respectively. 

10 

53. A surgical simulator for simulating medical surgery on a patient, the simulator 
comprising: 

a human body part model having a point of entry; 

a medical instrument provided on a first side of said human body part model, said medical 
15 instrument extending through said point of entry of said model to a second side of said model; 

a floating gimbal device coupled to said medical instrument, said floating gimbal device 
providing three degrees of freedom to said medical instrument; 

a force feedback interface device coupled to said floating gimbal device, said force feedback 
interface device providing movement to said medical instrument in three dimensions separate from 
20 said three degrees of freedom and providing forces to said medical instrument in said three 
dimensions, said force feedback device being coupled to a ground on said second side of said 
human body part model and including three actuators for generating said forces; and 

a plurality of, sensors coupled to said gimbal mechanism and to said force feedback 
interface device for sensing a position and orientation of said medical instrument. 

25 

54. A surgical simulator as recited in claim 53 wherein said three actuators are fixed to 
said ground and stationary with respect to said ground. 

55. A surgical simulator as recited in claim 54, wherein said sensors and said three 
30 actuators are coupled to a host computer. 

56. A surgical simulator as recited in claim 55, wherein said sensors and said three 
actuators are coupled to a local microprocessor that is coupled to said host computer, said local 
microprocessor being separate from said host computer. 



38 



ABSTRACT OF THF DISCLOSURE 

An apparatus and method for interfacing the motion of a user-manipulable object with a 
computer system includes a user object physically contacted or grasped by a user. A 3-D spatial 
mechanism is coupled to the user object, such as a stylus or a medical instrument, and provides 
three degrees of freedom to the user object. Three grounded actuators provide forces in the three 
degrees of freedom. Two of the degrees of freedom are a planar workspace provided by a closed- 
loop linkage of members, and the third degree of freedom is rotation of the planar workspace 
provided by a rotatable carriage. Capstan drive mechanisms transmit forces between actuators and 
the user object and include drums coupled to the carriage, pulleys coupled to-grounded actuators, 
and flexible cables transmitting force between the pulleys and the drums. The flexibility of the 
cable allows the drums to rotate with the carriage while the pulleys and actuators remain fixed to 
ground. The interface also may include a floating gimbal mechanism coupling the linkage to the 
user object. The floating gimbal mechanism includes rotatably coupled gimbal members that 
provide three degrees of freedom to the user object and capstan mechanisms coupled between 
sensors and the gimbal members for providing enhanced sensor resolution. 
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